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Entropy waves, the zig-zag graph product, 
and new constant-degree expanders 

By Omer Reingold, Salil Vadhan, and Avi Wigderson* 

Abstract 



The main contribution of this work is a new type of graph product, which 
we call the zig-zag product. Taking a product of a large graph with a small 
graph, the resulting graph inherits (roughly) its size from the large one, its 
degree from the small one, and its expansion properties from both! Iteration 
yields simple explicit constructions of constant-degree expanders of arbitrary 
i-Sh ' size, starting from one constant-size expander. 

Crucial to our intuition (and simple analysis) of the properties of this 
graph product is the view of expanders as functions which act as "entropy 
wave" propagators -- they transform probability distributions in which en- 
tropy is concentrated in one area to distributions where that concentration is 
dissipated. In these terms, the graph product affords the constructive interfer- 



ed , ence of two such waves. 

Subsequent work [ALW01], [MW01] relates the zig-zag product of graphs 
to the standard semidirect product of groups, leading to new results and con- 
structions on expanding Cayley graphs. 
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1. Introduction 

1.1. Expander graphs. Expanders are graphs which are sparse but never- 
theless highly connected. A precise definition will be given in the next section, 
but here we informally list some properties of such graphs (which are equivalent 
when formally stated and can serve as alternate definitions) 

• The graph satisfies "strong" isoperimetric inequalities. 

• Every set of vertices has "many" neighbors. 

• Every cut has "many" edges crossing it. 

• A random walk on the graph converges quickly to the stationary distri- 
bution. 

Expander graphs have been used to address many fundamental prob- 
lems in computer science, on topics including network design (e.g. [Pip87], 
[PY82], [AKS83]), complexity theory ([Val77], [Sip88], [Urq87]), derandomiza- 
tion ([NN93], [INW94], [IW97]), coding theory ([SS96], [Spi96]), and cryptog- 
raphy ([GILVZ90]). Expander graphs have also found some applications in 
various areas of pure mathematics [KR83], [Lub94], [GroOO], [LP01]. 

Standard probabilistic arguments ( [Pin73] ) show that almost every constant- 
degree (> 3) graph is an expander. However, explicit and efficient construction 
of such graphs (which is required by most of the computer science applications 
above) seems to be much harder. This problem leads to an exciting and exten- 
sive body of research, developed mainly by mathematicians intrigued by this 
computer science challenge. 
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Most of this work was guided by the algebraic characterization of ex- 
panders, developed in [Tan84], [AM85], [Alo86a]. They showed the intimate 
relation of (appropriate quantitative versions of) all the properties above to the 
spectral gap in the adjacency matrix (or, almost equivalently, the Laplacian) 
of the graph. Using it, expanders can be defined as follows: An infinite family 
G n of D-regular graphs is an expander family if for all n the second largest 
(in absolute value) eigenvalue of the adjacency matrix of G n is bounded uni- 
formly from above by the same X < D. (Note that the degree D is independent 
of n; this is what we mean by "constant degree.") 1 

This algebraic definition naturally led researchers to consider algebraic 
constructions, where this eigenvalue can be estimated. The celebrated sequence 
of papers [Mar 73], [GG81], [AM85], [AGM87], [JM87], [LPS88], [Mar88], 
[Mor94] provided such constant-degree expanders. All these graphs are very 
simple to describe: given the name of a vertex (in binary), its neighbors can 
be computed in polynomial time (or even logarithmic space). This level of 
explicitness is essential for many of the applications. However, the analysis 
bounding the eigenvalue is quite sophisticated (and often based on deep math- 
ematical results). Thus, it is hard to intuitively understand why these graphs 
are expanders. 

A deviation from this path was taken in [Ajt94], where a combinatorial 
construction of cubic expanders was proposed. It starts with an arbitrary cubic 
A-vertex graph and applies a sequence of polynomially many local operations 
which gradually increase the girth and turn it into an expander. However, 
the resulting graphs do not have any simply described form, and they lack 
the explicitness level (and hence applicability) of the algebraic constructions 
mentioned above. 

In this work, we give a simple, combinatorial construction of constant- 
degree expander graphs. Moreover, the analysis proving expansion (via the 
second eigenvalue) is as simple and follows a clear intuition. The construction 
is iterative, and needs as a basic building block a single, almost arbitrary ex- 
pander of constant size. The parameters required from it can be easily obtained 
explicitly, but exhaustive search is an equally good solution since it requires 
only constant time. Simple operations applied to this graph generate another 
whose size is increased but whose degree and expansion remain unchanged. 
This process continues, yielding arbitrarily large expanders. 



1 On an intuitive level, the connection between the spectral gap and the combinatorial and 
probabilistic properties of expanders listed above should not be surprising. For example, it is well 
known that the standard random walk on the graph converges exponentially with base X/D to the 
stationary uniform distribution. Moreover, equal partitions of the vertices of a graph, thought of 
as ±l-vectors, are orthogonal to the uniform distribution, and so the bilinear form representing the 
number of edges in the cut can be bounded in terms of the gap between D and A. 
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The heart of the iteration is our new "zig-zag" graph product. Informally, 
taking a product of a large graph with a small graph, the resulting graph 
inherits (roughly) its size from the large one, its degree from the small one, 
and its expansion properties from both! (That is, the composed graph has good 
expansion properties as long as the two original graphs have good expansion 
properties.) 

In the next subsections we give high level descriptions of the iterative con- 
struction, the new graph product, the intuition behind it, various extensions. 
We then mention subsequent work on the relation of the zig-zag product in 
graphs to the semidirect product in groups and its applications to expanding 
Cay ley graphs. 

1.2. Overview of expander construction. In this section, we describe a sim- 
plified, but less efficient, version of our expander construction and omit formal 
proofs. Our full construction is described in detail in Section 3. Throughout 
this section, all graphs are regular, undirected, and may have loops and parallel 
edges. The adjacency matrix of an N- vertex graph G is the matrix M whose 
(u, v) entry is the number of edges between vertices u and v. If the graph is 
L>-regular, then the normalized adjacency matrix is simply M/D. Note that 
this stochastic matrix is the transition probability matrix of the natural ran- 
dom walk on G, every step of which moves a "token" from a current vertex 
along a uniformly chosen edge to a neighboring vertex. It is easy to see that 
this matrix has an eigenvalue of 1, corresponding to the constant eigenvector, 
and it turns out that all other eigenvalues have absolute value less than 1. 
Our primary interest will be the second largest (in absolute value) eigenvalue 
(which is known to govern the convergence rate of the random walk, and as 
mentioned above is the essence of expansion). 

Thus, three essential parameters play a role in an expander — size, degree 
and expansion. We classify graphs accordingly. 

Definition 1.1. An (N,D, X)-graph is any .D-regular graph on N ver- 
tices, whose normalized adjacency matrix has second largest (in absolute value) 
eigenvalue at most A. 

The basic operations. We use two operations on (the adjacency matrices 
of) graphs — the standard matrix squaring, and our new zig-zag graph product. 
Here is their effect on these three parameters. 

SQUARING: Let G 2 denote the square of G. Then 

Fact 1.2. (n,d,X) 2 -> (n,d 2 ,X 2 ). 

The zig-zag product: Let G\ ®G 2 denote the new graph product of 
G\ and Gi- Then 
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Theorem 1.3. (N 1 ,D 1 ,\ 1 )®(D 1 ,D 2 ,\2) -► (A^i, D 2 , Ai + A 2 + A|). 

(The eigenvalue bound of Ai + A2 + X 2 is improved somewhat in Sections 3 
and 4.) 

The iterations. Let H be any (D 4 ,D, l/5)-graph, which will serve as the 
building block for our construction. We define a sequence of graphs Gi as 
follows. 

• Gi = H 2 , 

• G l+1 = G 2 ®H. 

From Fact 1.2 and Theorem 1.3 above, it is easy to conclude that this sequence 
is indeed an infinite family of expanders: 

Theorem 1.4. For every i, Gi is an (Ni,D 2 ,2/5)-graph with Ni = D il . 

This construction is not as efficient as we would like — computing neigh- 
borhoods in Gi takes time polynomial in Ni rather than polynomial in log TVj. 
As we show in Section 3, this is easily overcome by augmenting the iterations 
with another standard graph operation. 

1.3. The zig-zag graph product. The new product mentioned above takes 
a large graph and a small one, and produces a graph that (roughly speaking) 
inherits the size of the large one but the degree of the small one. This was the 
key to creating arbitrarily large graphs with bounded degrees. Naturally, we 
are concerned with maintaining the expansion properties of the two graphs. 
First, we describe the product. 

For simplicity, we assume that the edges in our D-regular graphs are 
.D-colored; that is, they are partitioned to D perfect matchings. (This as- 
sumption loses generality, and we will remove it in the formal construction in 
§2.) For a color i £ [D] and a vertex v let v[i] be the neighbor of v along the 
edge colored i. With this simple notation, we can formally define the zig-zag 
product ® (and then explain it). 

Definition 1.5. Let G\ be an Di-regular graph on [N\] and G 2 a 
I^-regular graph on \D{\. Then G\ ®G 2 is a ^-regular graph on [N\] x [D\\ 
defined as follows: For all v € [Ni], k G [D\],i,j £ [D2], the edge (i,j) connects 
the vertex (v,k) to the vertex (w[/c[i]], fc[i][j]). 

What is going on? Note that the size of the small graph G 2 is the degree 
of the large graph G\. Thus a vertex name in Gi ®G 2 has a first component 
which is a vertex of the large graph, and a second which is viewed both as a 
vertex of the small graph and an edge color of the large one. The edge label 
in G\ ® G 2 is just a pair of edge labels in the small graph. One step in the 
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new product graph from a vertex (v, k) along the edge (i, j) can be broken into 
three substeps. 

1. (v, k) — ► (v , k[i]) — A step ("zig") in the small graph moving k to k[i\. 
This affects only the second component, according to the first edge label. 

2. (v,k[i]) — > {v [k[i]\, k[i]) — A step in the large graph, changing the first 
component according to the second, viewed as an edge color. 

3. (v[fe[?]], k[i]) — ► (v[fc[i]], fc[i] [j]) -A step ("zag") in the small graph moving 
k[i] to A;[i][j]. This affects only the second component, according to the 
second edge label. 

1.4. Intuition. Why does it work? More precisely, why does Theorem 1.3 
hold? What this theorem says intuitively, is that G\ ©G 2 is a good expander 
as long as both G\ and G2 are good expanders. Consider the above three steps 
as a random walk on G±@G2- Then Steps 1 and 3 are independent random 
steps on the small graph. If at least one of them "works" as well as it does in 
the small graph, then this would guarantee that the new graph is as good an 
expander as the small one. So let us argue (very intuitively) that indeed one 
of them "works." 

A random step in an expander increases the (H2-) entropy of a distribu- 
tion on the vertices, provided that it is not already too close to uniform. Let 
us consider a distribution on the vertices of the new graph (v,k). Roughly 
speaking, there are two cases. 

• If the distribution of the second component k (conditioned on v) is not 
too uniform, then Step 1 "works." Since Step 2 is just a permutation 
and Step 3 is a random step on a regular graph, these steps cannot make 
the distribution less uniform and undo the progress made in Step 1. 

• If k (conditioned on v) is very close to uniform, then Step 1 is a "waste." 
However, Step 2 is then like a real random step in the large expander G\\ 
This means that the entropy of the first component v increases. Note 
that Step 2 is a permutation on the vertices of G\ ©G2, so if entropy 
increases in the first component, it decreases in the second. That means 
that in Step 3 we are in the good case (the conditional distribution on the 
second component is far from uniform), and the entropy of the second 
component will increase by the expansion of the small graph. 

The key to this product is that Step 2 is simultaneously a permutation (so 
that any progress made in Step 1 is preserved) and an operation whose "projec- 
tion" to the first component is simply a random step on the large graph (when 
the second component is random). All previous discussions of expanders fo- 
cused on the increase of entropy to the vertex distribution by a step along a 



THE ZIG-ZAG GRAPH PRODUCT 163 

random edge. We insist on keeping track of that edge name, and consider the 
joint distribution! In a good expander, if the edge is indeed random, the en- 
tropy propagates from it to the vertex. This reduces the (conditional) entropy 
in the edge. Thus the "entropy wave" in Step 2, in which no fresh randomness 
enters the distribution on vertices of G\ ® Gi , is what facilitates entropy in- 
crease in Steps 1 or 3. Either the "zig" step does it, if there is room for more 
entropy in k, or if not (which may be viewed as destructive interference of the 
large and small waves in Step 1), Step 2 guarantees constructive interference 
in Step 3. Moreover, Step 1 is not redundant as, if there is no or little ini- 
tial entropy in k, the wave of Step 2 (being a permutation) may flood k with 
entropy, destroying the effect of Step 3. 

The formal proof of Theorem 1.3 follows this intuition quite closely, and 
separately analyzes these two extreme cases. Indeed, since it becomes linear 
algebra, these two cases are very natural to define, and the only ones to worry 
about — all intermediate cases follow by linearity! Moreover, the variational 
definition of the second eigenvalue better captures the symmetry of the zig 
and zag steps (and gives a better bound than what can be obtained from this 
asymmetric intuition). 

1.5. Expanders and extractors. Here we attempt an intuitive explanation 
of how we stumbled on the definition of the zig-zag product, and the intuition 
that it does what it should. While this subsection may not be self-contained, 
it will at least lead the interested reader to discover more of the fascinating 
world of extractors. 

The current paper is part of research described in our conference paper 
[RVWOO] which deals with constructions of both expanders and extractors. 
Extractors are combinatorial objects, defined by [NZ96], which, roughly speak- 
ing, "purify" arbitrary nonuniform probability distributions into uniform ones. 
These objects are as fascinating and as applicable as expanders (see, e.g., the 
survey papers [Nis96], [NT99]). Like expanders, their applications demand 
explicit construction. Like with expanders, the quest for such constructions 
has been extremely fruitful and illuminating for complexity theory. Unlike ex- 
panders, the construction of optimal extractors is still a challenge, although 
the best existing ones are quite close to optimal (see the current state of the 
art, as well as a survey of previous constructions, in [RSWOO], [TUZ01]). 

Expander graphs were ingredients in some previous extractor construc- 
tions (as extractors may be viewed as graphs as well). Here the situation is 
reversed. The expander construction of this paper followed our discovery of 
nearly optimal high min- entropy extractors, which handle the "purification" of 
distributions which are already not too far from being uniform. A key idea in 
approaching optimality (following [RR99]) was preserving the unused entropy 
in a random step on an extractor. This lead to a (more complex) type of zig-zag 
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product, and from it, iterative constructions of such extractors. Translating 
this idea to the expander world turned out to be cleaner and more natural 
than in the extractor world. It led to our understanding of the role of the 
edge-name as a keeper of the unused entropy in a step of a standard random 
walk, and to the zig-zag product defined above. 



1.6. Extensions to the expander construction. The list below details the 
extensions and refinements we obtain to the basic expander construction out- 
lined above. All these will be part of the formal sections which follow. 

More explicit graphs. As mentioned above, this construction is not as effi- 
cient as we would like — computing neighborhoods in Gi takes time polynomial 
in Ni rather than in logiVj. As we show in Section 3, this is easily overcome 
by augmenting the iterations with another standard graph operation, namely 
taking tensor powers of the adjacency matrix. 

Describing graphs by "rotation maps." Another explicitness problem in 
the simple construction above is the assumption that the our D-regular graphs 
are given together with a proper D-coloring of the edges. This property is 
not preserved by the zig-zag product. To avoid it, we describe graphs more 
generally by their "rotation maps," and show how this description is explicitly 
preserved by all graph operations in our construction. 

Smaller degree. A naive and direct implementation of our graph product 
yields expanders whose degree is reasonable, but not that small (something 
under 1000). In Section 3.2, we show how to combine this construction, to- 
gether with one, constant-size cycle, to obtain an infinite family of explicit 
degree 4 expanders. Again, this combination uses the zig-zag product. In fact, 
using the replacement product described below, we obtain explicit degree 3 
expanders (which is the smallest possible). 

Choice of the base graph. Our expander construction requires an initial 
"constant size" base graph H as a building block. While exhaustive search 
can be used to find such an H (since it is constant size), for completeness we 
include two elementary explicit constructions (from [Alo86b, AR94]) which can 
be used instead. 

Better degree vs. eigenvalue relation. The best relationship between de- 
gree and second largest eigenvalue is obtained by Ramanujan graphs, in which 
the second eigenvalue is 2y ' D — 1/D. This equals the first eigenvalue of the 
.D-regular infinite tree, and it is known that no finite D-regular graph can have 
a smaller second largest eigenvalue (cf., [Alo86a], [LPS88], [Nil91]). Remark- 
able graphs achieving this optimal bound were first constructed independently 
by [LPS88] (who coined the term Ramanujan graphs) and by [Mar88]. 
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Our constructions do not achieve this tight relationship. The zig-zag prod- 
uct, applied recursively to one fixed Ramanujan graph, will yield Z)-regular ex- 
panders of second largest eigenvalue 0(1/-D 1 ' 4 ). A "partially derandomized" 
variant of our zig-zag product, given in Section 6, improves this relation and 
achieves second eigenvalue 0(1/ 'D 1 ' 3 ). 

A simpler product. Perhaps the most natural way to combine G\ with 
G<i when the size of G2 is the degree of G\ is simply replace every vertex of 
G\ with a copy of G2 in the natural way, keeping the edges of both graphs. 
This replacement product, which was often used for degree-reduction purposes 
(e.g., when Gi is a cycle the resulting graph has degree 3) turns out to enjoy 
similar properties of the zig-zag product: if both Gi and Gi are expanders, 
then so is their replacement product. Moreover, the proof is by a reduction — 
the zig-zag product is a subgraph of the cube (3 rd power) of the replacement 
product, immediately giving an eigenvalue bound. 

1.7. Subsequent work: Connections with semidirect product in groups. 
Subsequent to this work, it was shown in [ALW01] that the zig-zag (and re- 
placement) products can be viewed as a generalization of the standard semidi- 
rect product of groups. This was used in [ALW01] to construct a family of 
groups which is expanding with one (constant size) set of generators, but is 
not expanding with another such set. The connection was further developed 
in [MW01] to produce new families of expanding Cayley graphs, via bounds 
on the number of irreducible representations of different dimensions in terms 
of the expansion. 

1.8. Organization of the paper. In Section 2, we give preliminary def- 
initions and basic facts. In Section 3, we define the zig-zag graph product, 
describe the construction of expanders, and state their properties. In particu- 
lar, it deals with the first four "extensions" listed in the previous subsection. 
In Section 4, we analyze the expansion of the zig-zag product. In Section 5, we 
discuss some ways to obtain the base graph used in our expander construction. 
In Section 6, we give two extensions to the basic zig-zag product. The first is 
a "derandomized" variant of our basic zig-zag product, which enjoys a better 
relationship between the degree and the expansion. The second is the simple, 
natural replacement product. 

2. Preliminaries 

2.1. Graphs and rotations. All graphs we discuss may have self- loops 
and parallel edges. They are best described by their (nonnegative, integral) 
adjacency matrix. Such a graph is undirected if and only if the adjacency 
matrix is symmetric. It is D-regular if the sum of entries in each row (and 
column) is D (so exactly D edges are incident to every vertex). 
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Let G be a D-regulai undirected graph on N vertices. Suppose that the 
edges leaving each vertex of G are labeled from 1 to D in some arbitrary, but 
fixed, way. Then for v,w £ [N] and i £ [D], it makes sense (and is standard) 
to say "the i neighbor of vertex v is w." In this work, we make a point to 
always keep track of the edge traversed to get from v to w. This is formalized 
as follows: 

Definition 2.1. For a D-regular undirected graph G, the rotation map 
Rot G : [TV] x [D] -► [TV] x [D] is defined as follows: Rot G (v,i) = (w,j) if the 
i edge incident to v leads to w, and this edge is the j edge incident to w. 

This definition enables us to remove the simplifying assumption made 
in the introduction, which was that the label of an edge is the same from 
the perspective of both endpoints, i.e. Rotc(v,i) = (w,j) => i = j. From 
Definition 2.1, it is clear that Rote is a permutation, and moreover RotG°RotG* 
is the identity map. 

We will always view graphs as being specified by their rotation maps. 
Hence we call a family Q of graphs explicit if for every G £ Q, Rote is com- 
putable in time poly (log TV), where TV is the number of vertices of G. That is, 
graphs in Q are indexed by some parameters (such as the number of vertices 
and the degree, which may be required to satisfy some additional relations) 
and there should be a single algorithm which efficiently computes Rote for 
any G £ Q when given these parameters as an additional input. The notation 
poly() stands for a fixed (but unspecified) polynomial function in the given 
variables. We will often informally refer to an individual graph as explicit, as 
shorthand for saying that the graph comes from an explicit family. 

Our constructions will be iterative (or recursive), and will be based on 
a sequence of composition operations, constructing new graphs from given 
ones. The definition of these compositions (or products) will show how the 
rotation map of the new graph can be computed using "oracle access" to the 
rotation maps of the given graphs. (By giving an algorithm "oracle access" 
to a function /, we mean that the algorithm is given power to evaluate / on 
inputs of its choice at the cost of one time step per evaluation.) Given the 
time complexity of such a computation and the number of oracle calls made, 
it will be easy to compute the total time required by a recursive construction. 

2.2. Eigenvalues and expansions. The normalized adjacency matrix M of 
G is the adjacency matrix of G divided by D. In terms of the rotation map, 
we have: 



M uv = — 

u,v D 



{(i,j)£ [D] 2 :Rot G (u,i) = (v,j)} 



M is simply the transition matrix of a random walk on G. By the .D-regularity 
of G, the all-l's vector ljy = (1, 1, . . . , 1) 6 ^ N is an eigenvector of M of 
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eigenvalue 1. It is turns out that all the other eigenvalues of M have absolute 
value at most 1 , and it is well known that the second largest eigenvalue of G is 
a good measure of G's expansion properties [Tan84], [AM85], [Alo86a]. We will 
use the following variational characterization of the second largest eigenvalue. 

Definition 2.2. X(G) denotes the second largest eigenvalue (in absolute 
value) of G's normalized adjacency matrix. Equivalently, 

| (a, Ma) | [jMaJj 

A(G) = max — — = max — - — t^-. 

o±1jv (a, a) a±i N \\a\\ 

Above, (•, •) refers to the standard inner product in R and ||a|| = y/(a,a). 

The meaning of X(G) can be understood as follows: Suppose tt G [0, 1] N 
is a probability distribution on the vertices of G. By linear algebra, n can be 
decomposed as tt = ujv + tt^, where ujy = 1jv/A is the uniform distribution 
and it _L un- Then Mtt = un + Mtt is the probability distribution on 
vertices obtained by selecting a vertex v according to it and then moving to 
a uniformly selected neighbor of v. By Definition 2.2, \\Mtt || < X(G) • ||vr ||. 
Thus X(G) is a measure of how quickly the random walk on G converges to 
the uniform distribution. Intuitively, the smaller X(G) is, the better the ex- 
pansion properties of G. Accordingly, an (infinite) family Q of graphs is called 
a family of expanders if these eigenvalues are bounded away from 1, i.e. there 
is a constant A < 1 such that X{G) < X for all G & Q. It was shown by 
Tanner [Tan84] and Alon and Milman [AM85] that this implies (and is in fact 
equivalent to [Alo86a] ) the standard notion of vertex expansion: there is a con- 
stant e > such that for every G G Q and for any set S of at most half the 
vertices in G, at least (1 + e) • \S\ vertices of G are connected to some vertex 
in S. 

As mentioned in the introduction, we refer to a D-regular undirected graph 
G on N vertices such that X(G) < A as an (A, D, X)-graph. Clearly, achieving 
expansion is easier as the degree gets larger. The main goal in constructing ex- 
panders is to minimize the degree, and, more generally, obtain the best degree- 
expansion tradeoff. Using the probabilistic method, Pinsker [Pin 73] showed 
that most 3-regular graphs are expanders (in the sense of vertex expansion), 
and this result was extended to eigenvalue bounds in [Alo86a], [BS87], [FKS89], 
[Fri91]. The best-known bound on the eigenvalues of random graphs is due to 
Friedman [Fri91], who showed that most D-regular graphs have second largest 
eigenvalue at most 2j\fT) + 0((logD)/D) (for even D). In fact, the bound 
of 2\/D — l/D is the best possible for an infinite family of graphs, as shown 
by Alon and Boppana (cf. [Alo86a], [LPS88], [Nil91]). Graphs whose second 
largest eigenvalue meets this optimal bound are called Ramanujan graphs. It 
is easy to verify that this value is the largest eigenvalue of the random walk on 
the infinite D-regular tree. 
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While these probabilistic arguments provide strong existential results, ap- 
plications of expanders in computer science often require explicit families of 
constant-degree expanders. The first such construction was given by 
Margulis [Mar 73], with improvements and simplifications by Gabber and 
Galil [GG81], Jimbo and Maruoka [JM87], Alon and Milman [AM85], and Alon, 
Galil, and Milman [AGM87]. Explicit families of Ramanujan graphs were first 
constructed by Lubotzky, Phillips, and Sarnak [LPS88] and Margulis [Mar88], 
with more recent constructions given by Morgenstern [Mor94]. The best eigen- 
values we know how to achieve using our approach are O^/D 1 '^). 

2.3. Squaring and tensoring. In addition to the new zig-zag product, our 
expander construction makes use of two standard operations on graphs - 
squaring and tensoring. Here we describe these operations in terms of rotation 
maps and state their effects on the eigenvalues. 

Let G be a D-regular multigraph on [A] given by rotation map Rotg. 
The t th power of G is the D*-regular graph G t whose rotation map is given 
by Kotot(vo, (ki, k 2 , ■ ■ ■ j kt)) = (vt, (tfi&t-i, ■ ■ ■ )^i))j where these values are 
computed via the rule (vi,£i) = Rot^C^-i, h). 

Proposition 2.3. If G is an (A, D, X)-graph, then G* is an (A, D f , A*)- 
graph. Moreover, Rot G t is computable in time poly(log A, log D, t) with t oracle 
queries to Rote*. 

Proof. The normalized adjacency matrix of G l is the t power of the 
normalized adjacency matrix of G, so all the eigenvalues also get raised to the 
t th power. □ 

Let Gi be a Lq-regular multigraph on [Aq] and let G 2 be a ^-regular 
multigraph on [N2]. Define the tensor product G\®G 2 to be the D\ ■ Z^-regular 
multigraph on [Aq] x [N 2 ] given by Rot Gl0G2 ((v, w), (i,j)) = ({v',w'), {i',f)), 
where (v',i') = Rot(3 1 (v,i) and (w',f) = RotG 2 (w,j). In order to analyze this 
construction (and our new graph product), we need some concepts from linear 
algebra. For vectors a G M. x and (3 £ R 2 , their tensor product is the vector 
a (8) (3 G R"i'"2 w l! 0se (i, j') th entry is oti • f3j. If A is an N± x Aq matrix and 
B is an A2 x A2 matrix, then there is a unique N\N 2 x A1A2 matrix A <S> B 
(again called the tensor product) such that (A (g> B)(a<gi (3) = (Aa) (g> (B{3) for 
all a, (3. 

Proposition 2.4. IfG\ is an (Ni,Di, Xi)-graph andG 2 is an (A 2 , D 2 , A 2 )- 
graph, then G\ ® G 2 is an (Aq • N 2 ,D\ • D 2 ,max(\i,\ 2 ))- graph. Moreover, 
Rotc 1 0G 2 * s computable in time poly(log A1A2, log D\D 2 ) with one oracle query 
to Rotc 1 and one oracle query to Rotc 2 . 
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Proof. The normalized adjacency matrix of G\ ® G<i is the tensor product 
of the normalized adjacency matrices of G± and G2. Hence its eigenvalues are 
the pairwise products of eigenvalues of G\ and G^- The largest eigenvalue is 
1-1, and the second largest eigenvalue is either 1 • A2 or Ai ■ 1. □ 



3. The zig-zag product and the expander construction 

In the introduction, we described how to obtain a family of expanders by 
iterating two operations on graphs — squaring and the new "zig-zag" product. 
That description used a simplifying assumption about the edge labeling. In 
terms of rotation maps, the assumption was that Rot(u,i) = (w,j) => i = j. 
In this section, we describe the construction in terms of arbitrary rotation 
maps and prove its properties. The expander construction given here will also 
use tensoring to improve the efficiency to polylogarithmic in the number of 
vertices. This deals with the first two items in the "extensions" subsection 
of the introduction, which are summarized in Theorem 3.2. The third item, 
obtaining expanders of degree 4, will follow in Corollary 3.4. The analysis of 
the zig-zag product is deferred to the following section. 

3.1. The zig-zag graph product. We begin by describing the new graph 
product in terms of rotation maps. Let G\ be a Di-regular multigraph on [N\] 
and C?2 a Z^-regular multigraph on [Di\. Their zig-zag product is a D^-regular 
multigraph G±®G2 on [N\] x [D\]. We view every vertex v of G\ as being blown 
up to a "cloud" of D\ vertices (y, 1), . . . , (v, -Di), one for each edge of G\ leaving 
v. Thus for every edge e = (v,w) of G\, there are two associated vertices of 
G\ ©G2 -- (v,k) and (w,£), where e is the k th edge leaving v and the £ th 
edge leaving w. Note that these pairs satisfy the relation (w,£) = Rotc 1 (v,k). 
Since G<i is a graph on [D\], we can also imagine connecting the vertices of 
each such cloud using the edges of Gi- Now, the edges of G\ ©G2 are defined 
(informally) as follows: we connect two vertices (v, k) and (w,£) if it is possible 
to get from (y, k) to (w, £) by a sequence of moves of the following form: 

1. Move to a neighboring vertex (v,k') within the initial cloud (using an 
edge of G 2 ), 

2. Jump across clouds (using edge k' of Gi) to get to (w,£'), 

3. Move to a neighboring vertex (w,£) within the new cloud (using an edge 
ofG 2 ). 

To make this precise, we describe how to compute the KotQ 1 @Q 2 given Rotcj 
and Rotc 2 . 
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Definition 3.1. If G± is a Di-regular graph on [N\] with rotation map 
Rot ( ^ 1 and G2 is a Z^-regular graph on [Di] with rotation map Rotc 2 , then 
their zig-zag product G\®G2 is defined to be the D2" re S mar graph on \N\\ x [D±] 
whose rotation map Rot^^^ is as follows: 

Rot Gl@G2 ((v,k),(i,j)): 

1. Let (k',i') = Rot G2 (k,i), 

2. Let (w,f) = Rot Gl (v,k'), 

3. Let (£,/) = Rot G2 (f,j), 

4. Output ((w,£),(f,i')). 

The important feature of this graph product is that G\ ©G2 is a good 
expander if both G\ and G2 are, as shown by the following theorem. 

Theorem 3.2. If Gi is an (7V"i, D±, Ai)- graph and Gi is a (Di,D 2 , A2)- 
graph, then G\ ®Gi is a (N\ • D\, D\, /(Ai, X2))- graph, where f(\i,\2) < 
Ai + A2 + X 2 and f(X±, A2) < 1 w/ien Ai,A2 < 1. Moreover, Rot Gl ® G , 2 can 
be computed in time poly(log N, logi?i,log-D2) w?i/« one oracle query to Rot^ 
and two oracle queries to Rotc 2 . 

Stronger bounds on the function f(X±, A2) are given in Section 4. Before 
proving Theorem 3.2, we show how it can be used to construct an infinite 
family of constant-degree expanders starting from a constant-size expander. 

3.2. The recursion. The construction is like the construction in the intro- 
duction, except that we use tensoring to reduce the depth of the recursion and 
thereby make the construction run in polylogarithmic time (in the size of the 
graph) . 

Let H be a (D 8 ,D, A)-graph for some D and A. (Various methods for 
obtaining such an H are described in §5.) For every t > 1, we will define a 
(D 8t , D 2 , A^-graph G t . G\ is H 2 and G 2 is H®H. For t > 2, G t is recursively 
defined by 

Gt = {G l t^_- ] ®G v t^ 2 ®H. 

Theorem 3.3. For every t > 0, Gt is an (D 8t , D 2 , Xt)- graph with Xt = 
A+0(A 2 ). Moreover, Rotc t can be computed in time poly(i, log D) with poly(t) 
oracle queries to Rot#. 

Proof. A straightforward induction establishes that the number of vertices 
in Gt is D 8t and that its degree is D 2 . To analyze the eigenvalues, define 
fit = max{Ai, . . . , Ai}. Then we have jit < max{(U t _i, /j, 2 _ 1 + A + A 2 } for all 
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t > 2. Solving this recurrence gives \xt < A + 0(A 2 ) for all t. For the efficiency, 
note that the depth of the recursion is at most log 2 t and evaluating the rotation 
maps for Gt requires 4 evaluations of rotation maps for smaller graphs, so the 
total number of recursive calls is at most 4 g2 * = t 2 . □ 

In order for Theorem 3.3 to guarantee that graphs {Gt} are expanders, 
the second largest eigenvalue A of the building block H must be sufficiently 
small (say, A < 1/5). This forces the degree of H and hence the degree of 
the expander family to be rather large, though still constant. However, by 
zig-zagging the family {Gt} with a cycle, we can obtain a family of degree 
4 expanders. More generally, we can use this method convert any family of 
odd-degree expanders into a family of degree 4 expanders: 

Corollary 3.4. For every A < 1 and every odd D, there exists a X' < 1 
such that if G is an (N, D, X)-graph and C is the cycle on D vertices, then 
G@C is a (ND,4,X')-graph. 

Proof. As with any connected and nonbipartite graph, A(C) is strictly less 
than 1 for an odd cycle C (though X(C) — > 1 as D — ► oo). Thus, the corollary 
follows from Theorem 3.2. □ 



4. Analysis of the zig-zag product 

This section has two subsections. In the first, we give the basic (subop- 
timal) bound of Theorem 3.2. This bound uses only the intuitive ideas of the 
introduction, and suffices for the construction of the previous section. In the 
next, we state and prove a tighter eigenvalue bound. It uses extra information 
about the zig-zag product (which is less intuitive). It also gives more informa- 
tion about the worst interplay between the two extreme cases studied in the 
basic analysis, and may hopefully shed a bit of light on the structure of the 
eigenvectors of the zig-zag product. 

4.1. The basic eigenvalue bound. Now we prove Theorem 3.2. Recall the 
intuition behind the zig-zag product. We aim to show that for any (nonuni- 
form) initial probability distribution ir on the vertices of G±® G2, taking a 
random step on G\ ©G2 results in a distribution that is more uniform. We 
argued this intuitively in the introduction, by considering two extreme cases, 
based on the conditional distributions induced by it on the N± "clouds" of D\ 
vertices each: one in which these conditional distributions are far from uni- 
form, and the second in which they are uniform. The actual linear algebra proof 
below will restrict itself to these two cases by decomposing any other vector 
into a linear combination of the two. Also, the argument in the introduction 
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was not symmetric in the first and second steps on the small graph. Using the 
variational definition of the second largest eigenvalue, we get a cleaner analysis 
than by following that intuition directly. 

Let M be the normalized adjacency matrix of G\®G2- According to Defi- 
nition 2.2, we must show that, for every vector a 6 R * 1 such that a _L IjViDi, 
|(Ma,a)| is smaller than {a, a) by a factor /(Ai,A2). For intuition, a should 
be thought of as the nonuniform component of the probability distribution n 
referred to above, i.e. n = Un 1 d 1 + a, where un 1 Di = 1n 1 d 1 /NiDi is the 
uniform distribution on [iViDi]. Thus, we are showing that ir becomes more 
uniform after a random step on G\ ®G2- 

For every v £ [N\], define a v £ M. Dl by (a v )k = ctyfc- Also define a 
(linear) map C : R Nl - Dl -► R Nl by (Ca) v = J2k=i a vk- Thus, for a probability 
distribution ir on the vertices of G\ ©G2, vr„ is a multiple of the conditional 
distribution on "cloud v" and Ctt gives the marginal distribution on set of 
clouds. By definition, a = J2v e v ®a v , where e v denotes the v th standard basis 
vector in R x . By basic linear algebra, every a v can be decomposed (uniquely) 
into a v = av + a^ where a v is parallel to 1^ (i.e., all of its entries are the 
same) and a^ is orthogonal to \d 1 (i.e., the sum of its entries are 0). Thus, 
we obtain a decomposition of a: 

a = ^2e v <g>a v 

V 

V V 

a" + a . 



V 

def 



This decomposition corresponds to the two cases in our intuition: a" 
corresponds to a probability distribution on the vertices of G\ ©G2 such that 
the conditional distributions on the clouds are all uniform, a corresponds to 
a distribution such that the conditional distributions on the clouds are all far 
from uniform. Another way of matching a" with the intuition is to note that 
all = Ca® \d x JD\. Since a and a 1 - are both orthogonal to Ia^Di, so is a" 
and hence also Ca is orthogonal to 1^. 

To analyze how M acts on these two vectors, we relate M to the nor- 
malized adjacency matrices of G\ and G2, which we denote by A and B, 
respectively. First, we decompose M into the product of three matrices, corre- 
sponding to the three steps in the definition of G\ ©GVs edges. Let B be the 
(normalized) adjacency matrix of the graph on [N\\ x [D\] where we connect 
the vertices within each cloud according to the edges of G2. B is related to 
B by the relation B = ijvi ® B, where 1^ is the N\ x iVi identity matrix. 
Let A be the permutation matrix corresponding to Rotc 1 . The relationship 
between A and A is somewhat subtle, so we postpone describing it until later. 
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By the definition of G\ ®G 2 , we have M = BAB. Note that both B and A 
are symmetric matrices, due to the undirectedness of G\ and G 2 . 

Recall that we want to bound \(Ma, a)\/(a, a). By the symmetry of B, 

(1) (Ma, a) = (BABa, a) = (ABa, Ba). 

Now note that Ba" = a", because a" = Ca ® 1d 1 /D\, B = In 1 (g) B, and 
B1d 1 = Idi- This corresponds to the fact that if the conditional distribution 
within each cloud is uniform, then taking a random G 2 -step does nothing. 
Hence, Ba = B(a" + a 1 ) = a" + Ba 1 . Substituting this into (1), we have 

(2) (Ma, a) = (A(J + Ba ± ), J + Ba 1 ). 

Expanding and using the fact that A is length-preserving (because it is a 
permutation matrix), we have 

(3) \(Ma,a)\\(AJ,J)\ + 2\\J\\ ■ \\Ba ± \\ + \\Ba ± \\ 2 . 

Now we apply the expansion properties of G\ and G 2 to bound each of 
these terms. First, we bound ||5o;- L ||, which corresponds to the intuition that 
when the conditional distributions within the clouds are far from uniform, they 
become more uniform when we take a random C?2-step. 

Claim 4.1. H-Ba 1 !! < A 2 • Her 1 1|. 
Proof of claim. 



Ba 1 - = B I J2 e v <8> a 1 j 
= ^e„(g> Ba^. 



By the expansion of G 2 , ||Sa^|| < A2 • ||a^|| for all v. Hence, ll-Ba^ll < 
A 2 -||a- L ||. D 

Next, we bound |(Acr , a")|, which corresponds to the intuition that when 
the conditional distribution within each cloud is uniform, the jump between 
the clouds makes the marginal distribution on clouds themselves more uniform. 

Claim 4.2. ((Aa^a 11 )! < Ai • (a' 1 , a 11 ). 

Proof of claim. To prove this, we must first relate A to A. Recall that 
when k is uniformly distributed, Rot^j (v, k) gives a pair (w,£) where w is a 
uniformly selected neighbor of v. Similarly, if e v G R x is the v standard 
basis vector, then Ae v gives the uniform distribution over the neighbors of v. 
This similarity is captured by the formula CA(e v <8> 1d 1 /D±) = Ae v for all v. 
(Tensoring e v with l£> 1 /L'i corresponds to taking the uniform distribution 
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over k and applying C corresponds to discarding £ and looking just at w.) 
Because the e^'s form a basis, this formula extends to all vectors j3 £ M. Nl : 
CA(f3® lDi/Di) = A(3. Applying this formula to a" = Ca® l^/Di, we have 
CA(o'l) = ACa. Thus, 

(Aa\a^) = {Aoi i \Ca®l Dl )/D 1 
= (CAJ,Ca)/D 1 
= (ACa,Ca)/D 1 . 

Recalling that Ca is orthogonal to 1^ 1 , we may apply the expansion of G\ to 
obtain: 

|(iall,a")| < X 1 -(Ca,Ca)/D 1 

= \ 1 -(Ca®l Dl ,Ca®l Dl )/Dl 

= Ai • (a", a"). D 

Substituting the bounds of Claim 4.1 and 4.2 into (3), we have: 

(4) \(Ma,a)\ < Ai ■ Hct 11 1| 2 + 2A 2 • ll^'ll ■ Ha^H + A 2 ,- ||a ± f. 

If we let p = \\a"\\/\\a\\ and q = ||a- L ||/||Q||, then p 2 + q 2 = 1, and the 
above expression can be rewritten as: 

|(Afo:,Q:)| 2 2 2 2 

— ; r — <M-p + 2X 2 -pq + X 2 -q <Ai+A2+A 2 . 

{a, a) 

This shows that we can take /(Ai, A2) < Ai + A2 + A 2 ,. It remains to show 
that we can set /(Ai,A2) < 1 as long as Ai,A2 < 1. We consider two cases, 
depending on the length of \\a ||. First, suppose that \\a || < g^, 1 -||a||. Then, 
from (4), we have 

|(Ma,a)| < Ai-||a|| 2 + 2A 2 - (^T"^) IMP 

2 ^ 1-A^ 2 n ||2 ^ A 1-Ai\ „ l|2 

Now suppose that Ha -1 "!! > o^, 1 • ||a||. Notice that Ba 1 - is orthogonal to 
a": (Ba^,a"} = {a^,Ba") = (a^,^) = 0. Using this, we can bound (2) as 
follows: 

|(Ma,a)| = \(A(J + £a ± ), a 11 + £a ± )| < ||a !l + Ba L \\ 2 = \\J \\ 2 + \\Ba L \\ 2 

/1 x \ 2 

2 it L||2 i \2 || L ||2 ^ ||„,||2 /-, \2^ l A l \ m i|2 



^ II || 2 II -L||2 , \2 II _L||2 ^ II II2 I -\ \2\ J- \ II 

< || ck || — ||a || + A2 • ||a || < || ck || — (1 — A2) • [ — r — ) • ||a 

oX 



Thus, we can take 

"1-Ai (1-Ai) 2 -_(1-Al) 



/(Ai, A 2 ) < 1 - min — ^, ^ ^ -^ }> < 1 . 
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4.2. Improved analysis of the eigenvalue. In this subsection we state and 
prove an improved upper bound on the second largest eigenvalue produced by 
the zig-zag product. 

Theorem 4.3 (Thm. 3.2, improved). If Gi is an (N ± , D 1 , Ai )-graph and 
G2 is a (Di, D2, X2)- graph, then G\ ©G2 is a (N\ ■ D\,D 2 , /(Ai, X2))- graph, 
where 



i(l-Al)A 1 + i 



/(A„ A 2 ) = 5(1 - A|)A t + -J(l - AD'Af + 4A| 



Although the function /(Ai, A2) looks ugly, it can be verified that it has 
the following nice properties: 

1. /(A,0) = /(0,A) =Aand/(A,l) =/(l,A) = 1 for all A € [0,1]. 

2. /(Ai, A2) is a strictly increasing function of both Ai and A2 (except when 
one of them is 1). 

3. If Ai < 1 and A 2 < 1, then /(Ai, A 2 ) < 1. 

4. /(Ai, A 2 ) < Ai + A 2 for all Ai, A 2 € [0, 1]. 

Proof. The proof proceeds along the same lines as the proof of Theo- 
rem 3.2, except that we will use a geometric argument to directly bound (2) 
rather than first passing to (3). That is, we must bound (using the same 
notation as in that proof) 

{Ma, a) (I(a" + Ba 1 ), all + 5a 1 ) 
(a, a) ||o;ll + a 1 ]] 2 

The key observation is: 

Claim 4.4. A is a reflection through a linear subspace S of R x x . Hence, 
for any vector v, (Av, v) = (cos2#) • \\v || 2 , where 9 is the angle between v and S. 

Proof of claim. By the symmetry of A, we can decompose K * x into the 
sum of orthogonal eigenspaces of A. Since A 2 = IniDu the only eigenvalues of 
A are ±1. Take S to be the 1-eigenspace of A. D 

Thus, the expression we want to bound is 

|(Ma,a)| 11^+ ^H 2 , ofll cos 2 
- \cos2&\ • — — n r^~ = coszt^ • 



2M- 



(a, a) \\a" + a^W 2 ' cos 

where is the angle between a" +-Ba _L and S, <p £ [0, 7r/2] is the angle between 
a" and all + a 1 , and <fi' G [0, 7r/2] is the angle between a" and a" + Ba^~. 
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If we also let ip be the angle between all and S, then we clearly have 6 G 

Now we translate Claims 4.1 and 4.2 into this geometric language. Claim 4.1 
constrains the relationship between (ft' and (ft by 

tan<// WBa^W 

t^ = V^r ^ A2 - 

tan<p 1 1 o;— "- 1 1 

Claim 4.2 says |cos2?/>| < Ai. For notational convenience, we will denote the 
exact values of (tan0')/(tan0) and |cos2^| by fi2 and //i, respectively. We will 
work with these values until the end of the proof, at which point we will upper 
bound them by A2 and Ai. 

To summarize, we want to maximize 

(5) |cosz#| • 



cos 2 ^' 



over the variables 6, (ft, (ft' , and ift, subject to the following constraints: 

1. <^',V€[0,7r/2]. 

2. 6e [^ -</>', V + </>']- 2 

3. tan 0'/ tan = fj,2- 

4. |cos2t/>| = \x\. 

There are two cases, depending on whether |cos2x| ever achieves the value 1 
in the interval [ip — (ft',ip + (ft']. 

Case I. eft' < min{^, ir/2 — ip}. Then 

|cos26>| = max{\cos2(ip + (ft')\,\cos2(ip — (ft>')\} 
= |cos2-(/> • cos20 | + | sin2'0 • sin 2(ft \. 

After some trigonometric manipulations, we have 

COS 2 (/> 1 ,_ ox _ , ,_ o> „ , _ , 1 , 



\cos26\-- 



COS 



2 d>' 2 



'1 — ^ 2 ) cos 2V' + (1 + /U 2 )cos2t/>cos2<^> H — |2^ 2 sin 2-0 sin 2<^>|. 



The choice of </> which maximizes this is to have (cos2</>, sin 2(ft) be a unit vector 
in the direction of (±(1 + /^ 2 )cos2t/>, 2[i2 sin2^/>); thus 

|cos2fl| • C ° S 9 t < -(1 - /i|)|cos2^| + - \/(l + ^) 2 cos 2 2V> + 4//| sin 2 2*/> 



COS^ 



-(1 - mI)Mi + g V^ 1 + ^)V? + 4Ml(l - M?)- 



2 We do not require 8 £ [0, vr/2] so that we do not have to worry about "wraparound" in the 
interval [ip — 4>',ip + </>']. Adding a multiple of tt/2 to does not change the value of (5). 
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Case II. (/)' > min{^,7r/2 — ip}. In this case, we cannot obtain any 
nontrivial bound on |cos2#|, so, after some trigonometric manipulations, the 
problem is reduced to bounding: 

(6) cos26> j— < 2T7 = fi 2 + (1 - ^ 2 )cos <p. 

The condition <f>' > min{^, ir/2 — ip} implies that cos20' < |cos2-(/;| = ji\. After 
some trigonometric manipulations, we have 

cos2<// = ( 1 + V2) cos2( P ~ f4 
(1 - ^)cos 2 (f) + /z 2 .' 

and the condition cos20' < ix\ is equivalent to 

cos 2 ^< ^( 1 +Mi) 



(1-Mi)+M|(l + Mi)" 

Substituting this into (6) and simplifying, we conclude that 

I ofl , cos 2 ^ 2/x| 

cos2t^ • r— - < 



cos 



2 M 



1-Mi + /^(1 + Mi)' 



It can be verified that the bound obtained in Case I is an increasing 
function of \i\ and ^2 and is always greater than or equal to the bound in 
Case II. Therefore, replacing hi and 1x2 by Ai and A2 in the Case I bound 
proves the theorem. □ 

5. The base graph 

Our construction of an infinite family of expanders in Section 3.2 requires 
starting with a (D 8 , D, A)-graph H (for a sufficiently small A, say < 1/5). 
Since D is a "constant," such a graph can be found by exhaustive search 
(given that one exists, which can be proven by (nontrivial) probabilistic ar- 
guments [Alo86a], [BS87], [FKS89], [Fri91]). However, for these parameters, 
there are simple explicit constructions known. We describe two of them below. 
The first is simpler and more intuitive, but the second yields better parameters. 

5.1. The affine plane. The first construction is based on the "projective 
plane" construction of Alon [Alo86b], but we instead use the affine plane in 
order to make ./V exactly D 2 and then use the zig-zag product to obtain a 
graph with iV = D s . For a prime power q = p f , let ¥ q be the finite field of size 
q; an explicit representation of such a field can be found deterministically in 
time poly(p, i) [Sho90]. We define a graph AP g with vertex set F 2 and edge 
set {((a, b), (c, d)) : ac = 6 + d}. That is, we connect the vertex (a, b) to all 
points on the line L a ^ = {(x,y) : y = ax — b}. (Note that we have chosen the 
sign of b to make the graph undirected.) 
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Lemma 5.1. APg is an (q 2 ,q, 1/ '^/q)- graph. Moreover, a rotation map for 
APg can be computed in time poly(logg) given a representation of the field ¥ q . 

Proof. The expansion of AP g will follow from the fact the square of AP^ 
is almost the complete graph, which in turn is based on the fact that almost 
all pairs of lines in the plane F^ intersect. Let M be the q 2 x q 2 normalized 
adjacency matrix of AP^; we will now calculate the entries of M 2 . The entry of 
M 2 in row (a, b) and column (a 1 , b') is exactly the number of common neighbors 
of (a, b) and (a' , b') in AP,j divided by q 2 , i.e., \L a ^ n L a tp\/q 2 . If a ^ a', then 
L a f) and L a ip intersect in exactly one point. If a = a' and b ^ b' , then their 
intersection is empty, and if a = a 1 and b = b' , then their intersection is of size 
q. Thus, if we let I q denote the q x q identity matrix and J q the q x q all-l's 
matrix, we have 



M2 =i 



( ql q J q ■■■ J q \ 



Jq 



Iq <8> qlq + (Jq ~ Iq) ® J, 



<l 



\ Jq J q ■■■ ql q J 

Now we can calculate the eigenvalues explicitly. J q has eigenvalues q (multi- 
plicity 1) and (multiplicity q— 1). So ( J q — I q ) ® J q has eigenvalues (q — 1) • q, 
—1-q, and 0. Adding I q <8) ql q increases all these eigenvalues by q, and then 
we divide by q 2 . Hence the eigenvalues of M 2 are 1 (multiplicity 1), (multi- 
plicity q — 1), and 1/q (multiplicity (q — 1) ■ q). Therefore, the second largest 
eigenvalue of M has absolute value 1/^/q. 
A rotation map for AP g is given by 



Rot,((a,6),t) 



f ((t/a,t-b),t) ifa/0andt/0, 



\((t,-b),a) if a = 0ort = 0, 

where a, b, t € ¥ q . □ 

Now, define the following graphs inductively: 

API = APg^APq 

AP; +1 = AP^©AP g . 

From Proposition 2.4 and Theorem 3.2, we immediately deduce: 

Proposition 5.2. AP^ is a (q 2 ( t+l \q 2 ,0(i/ yfq))- graph? Moreover, a 
rotation map for AP* can be computed in time poly(z,logg) given a represen- 
tation ofWq. 



3 The hidden constant in 0(i/^/q) can be reduced to 1 using the improved analysis of the zig-za 
product in Theorem 4.3. 
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Taking i = 7 and a sufficiently large q gives a graph suitable for the 
expander construction in Section 3.2. 

5.2. Low- degree polynomials. The graphs we describe here are derived 
from constructions of Alon and Roichman [AR94], which are Cayley graphs 
derived from the generator matrix of an error-correcting code. In order to give 
a self-contained presentation, we specialize the construction to a Reed-Solomon 
code concatenated with a Hadamard code (as used in, e.g. [AGHP92]). 

For a prime power q and d £ N, we define a graph LD g ^ on vertex set 
¥ d+l with degree q 2 . For a vertex a G ¥ d+1 and x,y E F g , the the (x,y) th 
neighbor of a is a + (y, j/x, yx 2 , . . . , yx rf ). 

Proposition 5.3. LD g ^ is a (q d+1 ,q 2 ,d/q)- graph. Moreover, a rotation 
map for LD,^ can be computed in time poly(logg,d) given a representation 
of¥ q . 

As above, taking d = 7 and sufficiently large q gives a graph suitable 
for our expander construction. These graphs are better than those of Propo- 
sition 5.2 because the the eigenvalue-degree relationship is the optimal A = 
0(1/ yD) (as q grows), which implies an eigenvalue of 0(1/ D 1 ' 4 ) for the fam- 
ily constructed in Theorem 3.3. 

Proof. To simplify notation, let F = ¥ q . Let M be the q d+l x q d+1 nor- 
malized adjacency matrix of LD,^. We view vectors in C q as functions 
/ : F +1 — ► C. We will now explicitly describe the eigenvectors of M. Let p be 
the characteristic of F, let £ = e 2m ' p be a primitive p root of unity, and let 
L : F — ► ¥ p be any surjective F p -linear map. (For simplicity, one can think of 
the special case that p = q and L is the identity map.) 

For every sequence a = (ao, . . . ,ad) £ ¥ d+1 , define the function \a '■ 
¥ d+1 ^ C by Xo (6) = C L{ ^ a ' bt) - Clearly, X a(b + c) = Xa(%a(c) for any 
6, c G F ^ 1 . Moreover, it can be verified that the {xa} are orthogonal under 
the standard inner product (/, g) = J2bf(b)g(b)*, and thus form a basis for 
C q . Hence, if we show that each Xa is an eigenvector of M, then they are 
all the eigenvectors of M. This can be done by direct calculation: 

(M Xa )(b) = -2 E M bc-Xa{c) 

= ~~2 H Xa(&+ (y,ya;, ...,yx d )) 

/'Ex ) i/eFXo(y,ya; > ---,ya^) , \ 
- ' 2 • Xo(6) 



dcf 



Aa-Xa(b)- 
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Thus, Xa is an eigenvector of M with eigenvalue A a and all eigenvectors 
of M are of this form. So we simply need to show that |A a | < d/q for all but 
one a 6 F d+1 . To do this, note that 



Xa = ~~2 Yl Xa((y,yx,...,yx d )) = -r V C 
o — o — 



i(j/'Po(x)) 



where p (x) is the polynomial ao + aix + • • • + a^x d . When x is a root of p a , 
then Q L yyP a \ x >> = 1 for all y; hence x contributes q/q 2 = 1/q to A a . When x 
is not a root of p a (x), yp a (x) takes on all values in F as y varies, and hence 
^ L (ypa(x)) var i es uniformly over all p th roots of unity. Since the sum of all p th 
roots of unity is 0, these x's contribute nothing to A a . When a / 0, p a has at 
most d roots, so |A a | < d/q. □ 



6. Variants on the zig-zag theme 

The two subsections of this section contain two variants of the basic zig- 
zag product. The first is aimed at improving the relation between the degree 
and the eigenvalue bound. The second is aimed at simplifying the product, at 
the cost of deteriorating this relationship. 

6.1. A " derandomized" zig-zag product. In this section we provide a vari- 
ant of our original zig-zag product, which achieves a better relationship between 
the degree and the expansion of the resulting graph. The term "derandomized" 
will become clearer when we define it. 

Recall that the optimal second-largest eigenvalue for an infinite family 
of Z)-regular graphs is 0(1/D 1 ' 2 ), and families of graphs meeting this bound 
(with the right constant) are referred to as Ramanujan. A basic question is how 
close can we come to this optimal bound using our techniques. Starting with a 
constant-size Ramanujan graph (or the graphs of §5.2), our basic construction 
of Theorem 3.3 achieves a second-largest eigenvalue of 0(1/ D 1 ' 4 ) for the family 
of expanders generated.. 

Here, we define a variant of the zig-zag product, which makes more ef- 
ficient use of the expansion of the small graph. Using the new product in 
our iterative construction (of §3.2) with an initial constant-size Ramanujan 
graph or even the graphs of Proposition 5.3, we obtain a second-largest eigen- 
value of 0(1/ 'D 1 / 3 ) for the family of expanders generated. It is an interesting 
open problem to construct families of graphs achieving the optimal eigenvalue 
0(1/ D 1 ' 2 ) using a similar graph product. 

We now turn to the formal definition of the new zig-zag product. It will 
have two "zig" moves and two "zag" moves, but they will not be independent. 
The second "zig" and the first "zag" will use the same random bits! 
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Definition 6.1. Let G\ be a Di-regular graph on \N\\ with rotation map 
Rotcr 1 and let G 2 be a Z) 2 -regular graph on [D±] with rotation map Rotc 2 . 
Suppose that for every i € [D2], Rot<3 2 (-,i) induces a permutation on [-D1]. 4 
Then the modified zig-zag product of G\ and G 2 is defined to be the Df-regular 
graph G\ ® G2 on [Ni] x \D\\ whose rotation map Rot G (g' G is as follows: 

^ot Gl&G2 ({v,k),(h,i,j)): 

1. Let (fc',/i') = Rot G2 (fc,/i). 

2. Let (fc",i') = Rot G r 2 (A; / ,i). 

3. Let (iu,£") =RotGi («,*:")■ 

4. Find the unique £' £ [Di] such that (T',i") = Rot G2 (f,i) for some i". 
(£' exists by the assumption on Rot G2 .) 

5. Let(e,j') = Rot G2 (f,j). 

6. Output ((w,e),(j',i,ti)). 

Again, in this graph product we do two random steps on the small graph 
in both the zig and the zag parts. However, to save random bits (i.e., decrease 
the degree) we use the same random bits for the second move of the zig part 
and the first move of the zag part. Thus the degree of the new graph is D^- 
However, we will show that the bound on the eigenvalue will be as if these 
moves were independent. This proof will follow the lines of the basic analysis 
of the original zig-zag product. 

Theorem 6.2. If Gi is an (N±, D-y, Ai )-graph and G 2 is a (Di,D 2 ,A 2 )- 
graph, then G\ ® G 2 is a (N\ • D±, D|, Ai + 2A|)- graph. Moreover, Rot Gl( g' G2 
can be computed in time poly (log N, log D\, D 2 ) with one oracle query to Rot Gl 
and -D 2 + 2 oracle queries to Rotcr 2 • 

Proof. We use the same notation as in the proof of Theorem 3.2. Like 
there, we need to bound \{Ma, a)\/(a, a), where M is the normalized adjacency 
matrix of G\® G 2 and a _L 1n 1 d 1 - Let B{ be the D\ x D\ permutation matrix 
induced by Rotc 2 (-, i), and let Bi = I^ 1 ® Bi. Then 

1 ° 2 
B = —YB t . 



4 By this we mean that the function fi(x) = "the first component of RotQ 2 (x, i)" 
"the i th neighbor of x" is a permutation for every i. 
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Note that the normalized adjacency matrix corresponding to Steps 2-4 in the 
definition of G\ ® G2 is given by 

where B- is the transpose (equivalently, inverse) of Bi. Thus, M = BM' B. 
The main observation is that not only does Ba" = a" (as we used in the original 
analysis), but also Bfa" = a" for every i (because Bi is a permutation matrix). 
Hence, 

M'J = — V BiABjJ = — V BiAJ = BAJ . 

Applying this (and the symmetry of B and M'), we get 

(Ma, a) = (Ma ll ,a") + 2{Ma ll ,a 1 ) + (Ma 1 1 a i ) 

= (Aa ll ,a 11 ) + 2(AJ,B 2 a ± ) + (M'Ba L ,Ba L ). 

Being the normalized adjacency matrix of an undirected, regular graph, M' 
has no eigenvalues larger than 1 and hence does not increase the length of any 
vector. Using this together with Claims 4.1 and 4.2, we have 

\(Ma,a)\ < |(Aa ll ,a ll )|+2||a ll || • \\B 2 a L \\ + {{B^f 

< Ai • ||a ll || 2 + 2A^- Ha 11 !] • {{a^W + A| ■ {{a^f. 

As in the the proof of Theorem 3.2, using the fact that ||a" || 2 + Ha -1 "!! 2 = ||«|| 2 
yields the desired bound. □ 

6.2. The replacement product. In this section, we describe an extremely 
simple and intuitive graph product, which shares similar properties to the zig- 
zag product. Namely, when taking the product of two expanders, we get a 
larger expander whose degree depends only on that of the smaller graph. Here 
simplicity is the important feature, and the expansion quality is not as good as 
above. This product is so natural that it was used in various contexts before. 
Indeed, Gromov [Gro83] even estimates the second eigenvalue of an iterated 
replacement product of the graph of the Boolean hypercube with smaller copies 
of itself. (Of course, in this very special case the outcome is not expanding, 
since the cube is not.) Our proof of its expansion will be a simple reduction to 
the expansion properties of the zig-zag product. However, one can also prove 
it directly in a manner similar to the proof of Theorem 3.2 (and thereby obtain 
a stronger bound). 

Assume (as in the basic zig-zag product) that G\ is a L>i-regular graph 
on [N\] and G2 is a Z^-regular graph on [Di\. A natural idea is to place a 
"copy" (or "cloud" ) of G2 around each vertex of G\ , maintaining the edges of 
both. More precisely, every vertex will be connected to all its original neighbors 



THE ZIG-ZAG GRAPH PRODUCT 183 

in its cloud, as well as to one vertex in the neighboring cloud it defines. For 
example, if Gi is the n-dimensional Boolean cube graph, and G 2 is the cycle on 
n vertices, then the resulting graph is the so-called cube connected cycle, which 
used to be a popular architecture for parallel computers. Note that in this 
example the small graph had degree 2, and the product graph had degree 3. 
In general, the resulting graph would have degree D 2 + 1. In terms of rotation 
maps, this product is defined as follows. 

Definition 6.3. If G\ is a Di-regular graph on [N\\ with rotation map 
Rotd and G 2 is a Z^-regular graph on [D\] with rotation map Rotc 2 , then 
their replacement product G\ ®G 2 is defined to be the (D 2 + l)-regular graph 
on [iVi] x [D\] whose rotation map Rotg^^ is as follows: 

^ot Gl@G2 {(v,k),i): 

1. If i < D 2 , let (m,j) = Rotc 2 (/c,i) and output ({v,m),j). 

2. If i = D 2 + 1, output (Rotc^v, k),i). 

The expansion properties of the replacement product are given in the next 
theorem, relating it to those of the zig-zag product. 

Theorem 6.4. If Gi is an (Ni, D\, X\ )-graph and G 2 is a (Di,D 2 ,X 2 )- 
graph, then G\ ®G 2 is a (N± • D\,D 2 + 1, g(X\, X 2 , D 2 ))-graph, where (using 
the function f from Theorems 3.2 or 4.3) 

g(X 1 ,X 2 ,D 2 )<(p+(l-p)f(X 1 ,X 2 )) 1/3 , 

and p = D\j{D 2 + l) 3 . In particular, g(\\, X 2 , D 2 ) < 1 when Ai,A2 < 1. 
Moreover, Rot^^^ can be computed in time poly(log N, logDi,log.D2) with 
one oracle query to Rot^ or Rotc 2 • 

Proof. The idea of the proof is that the graph of the zig-zag product is a 
regular subgraph of the cube of the graph of the replacement product. Let M 
denote the normalized adjacency matrix of G\ ®G 2 . As in the proof of The- 
orem 3.2, we let A, B respectively denote the normalized adjacency matrices 
of G\,G 2 , and define their "liftings" A, B in the same way. By inspection, we 
have M = (A + D 2 B) / (D 2 + 1). The key observation is that 

where BAB is the normalized adjacency matrix of G\®G 2 , C is the normalized 
adjacency matrix of an undirected, regular graph (and in particular does not 
increase the length of any vector), and p = D\j{I) 2 + l) 3 . As eigenvalues of 
powers of matrices are the respective powers of the original eigenvalues (see 
Proposition 2.3), we have 

g(Xi,X 2 )<(p+(l- P )f(Xi,X 2 )) 1 / 3 . D 
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Thus, for "constant" degrees -D 2 the replacement product indeed trans- 
forms two expanders into a larger one. As in Corollary 3.4, we can use this to 
get degree 3 expanders. 

Corollary 6.5. For every A < 1 and every odd D, there exists a X' < 1 
such that if G is an (TV, D, X)-graph and C is the cycle on D vertices, then 
G®C is a (ND,3,X')-graph. 

To make the expansion properties in Theorem 6.4 independent of how 
large D 2 is, we now slightly modify the replacement product to have L> 2 copies 
of each edge which goes between clouds. This makes the degree of every vertex 
2D2, of which D2 stay within the same cloud, and the other D2 all connect to 
the same vertex in a neighbor cloud. This "balancing" make the random walk 
give the same weight to edges defined by G\ and G 2 . 

Definition 6.6. If G± is a Di-regular graph on [N\] with rotation map 
Rot Gl and G2 is a Z) 2 -regular graph on [D\] with rotation map Rot Ga , then 
their balanced replacement product G\ © G2 is defined to be the 2D 2 -regular 
graph on [N\\ x [Di] whose rotation map Rot Gl (gj G2 is as follows: 

Rot Gl ® G2 ((t>,/c),i): 

1. If i < D2, let (m,j) = Rot Ga (A;,i) and output ((v,m),j). 

2. If i > D2, output (RotGi(w, k),i). 



Theorem 6.7. If G± is an (Ni,Di,Xi)- graph and G 2 is a (Di,D 2 , X2)- 
graph, then Gi © G2 is a (-^1 ■ Dii^D2,h(Xi, X2))- graph, where (using the 
function f from Theorems 3.2 or 4.3) 

(1 1 x 1 / 3 

MAi,A 2 )< _ + -./(Ai,A 2 r 



In particular, /i(Ai,A 2 ) < 1 when A 1; A 2 < 1. Moreover, Rot Gl (g) G2 can be 
computed in time poly(log N, logi?i,logZ) 2 ) with one oracle query to Rot Gl 
and one oracle query to Rot G2 - 

Proof. The proof is the same as that of Theorem 6.4, noting instead that 

M = (A + B)/2. □ 

As a final note, we observe the weakness of the replacement products 
relative to the zig-zag product. Informally, in zig-zag the expansion quality of 
the product improves with those of its component, while in the replacement it 
does not. More formally, while the function /(Ai,A 2 ) tends to zero when Ai 
and A 2 do, the functions g(\\, A 2 , D 2 ) and h(\\, A 2 ) do not. 
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